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Abstract 

In this paper, we consider the following PDE involving two Sobolev-Hardy critical expo- 
nents, 

Au + A—- H = in , ^ 

Ix]"^ (0.1) 

u = on r2, 

where 0<S2<si<2, Ot^AgM and G dfl. The existence (or nonexistence) for 
least-energy solutions has been extensively studied when si = or S2 = 0. In this paper, 
we prove that if < S2 < si < 2 and the mean curvature of dil at H{Q) < 0, then (|0.ip 
has a least-energy solution. Therefore, this paper has completed the study of (jO.ip for the 
least-energy solutions. We also prove existence or nonexistence of positive entire solutions 
of (|0.1|) with Q = under different situations of si,S2 and A. 

1 Introduction 

Let < s < 2, 2*(s) = and L2*(^)( A|L) denote the space of /with / l/P'^"^ -[fp < 

-l-oo. It is well known that the inclusion Hq{Q) '■*''(]^) is a family of non-compact 

embeddings. In this paper, we want to study the combined effect of two such Sobolev-Hardy 
critical exponents on a nonlinear partial differential equation. More precisely, we consider 

A- + A^^^ + ^^^^ = ma ^^^^ 
u{x) > in u{x) =0 on dfl, 

where < S2 < si < 2 and A G K. Throughout the paper, 51 is a bounded smooth domain 
in with e dn. 

Our motivation for studying equation comes from the celebrated Caffarelli-Kohn- 
Nirenberg inequality [1] : there exists a constant C such that for any u G C(^{R'^), the 
inequality 
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holds, where -oo < a < < b - a < I and q = N-2+2{b-a) ■ ^I'^i^) be the 

completion of C^{il) with the norm = /jjn | Vwpdx, and set 



S{a,b;n)^ inf 



^ |a-|-2a|VM|2da; 



Naturally, we ask whether the best constant S{a, b; ft) can be attained by some u G £'^'■^(17) \ 
{0}. For the past twenty years, this problem has been extensively studied. For recent 
development, we refer the readers to [TJ [3 1 [IS [H [H [H [HI [H [Ml H and the 
references therein. 

When G c?r2, this problem was first studied by Ghoussoub-Kang [Tl] and Ghoussoub- 
Robert [15], also see [11]. In [11], among other things, Chern and the second author of this 
paper proved the following theorem. 

Theorem A. Suppose £ dQ and the mean curvature H{0) < 0. Then the best constant 
S{a,b;Q) can be achieved in D^'^(r2) ifa,b,q satisfy one of the following conditions: 

(i) a <b < a + 1 and N >3, 

(a) b = a>0 and N > A. 

When a = and < 6 < 1 , TheoremlXl was first proved by Ghoussoub and Robert [TS] . 
The proof of TheoremlXl in [TT] is to make use of a transformation; u{x) ~ \x\~°-'v{x). 
Straightforward computations give 



where A = a{N — 2 — a). Then S{a, b; il) is equal to the following best constant: 

J \Vu\^dx-Xj^iSdx 
Sxii^) = inf — — , (1.2) 



where A = a{N - 2 - a) and s = {b ~ a)q e [0, 2) if 6 < a + 1. Note that if 5 = a + 1, 
thus s ~ 2 and the question for the best constant is a linear problem. Hence, we always 
exclude the case b = a + 1. By (|1.2p . Theoremf^ is equivalent to saying that equation (jl.ip 
has a solution provided that either (i) iV > 3, A < i^^)"^, < S2 < si = 2, or (h) > 4, 
< A < si^2 and S2 = 0. 

To study equation (jl.ip . we consider the nonlinear functional <P: 

Hu) 77 / Nul^dx / ^^-n dx / -^-n dx 

for M € HliQ), where for the simplicity of notations, weletpi = 2*(si) — 1 andp2 = 2*(s2) — 1. 
It is easy to see that there is positive constants poi co > such that 

<P[u) > Co if \\u\\hi =Po. 

Note that p2 > pi because si > S2 . Thus, no matter what the sign of A is, there is uq € Hq (fl) 
such that <f>(uo) < 0. Set 

= inf max<?(w), (1.3) 

Per weP 
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where V is the class of continuous paths in H}^{Vl) connecting and ito. We note that since 
P2 > Pi, the function t — !• 'P{tu) has the unique maximum for t > 0. Furthermore, we have 

c* = inf max <P{tu). 

ueH^^{n)u>o,u^o 

It is well-known that due to the non-compact embedding of Hq ^ '■*Hjfp)j ^ does not 
satisfy the Palais-Smale condition. Therefore, in general c, might not be a critical value for 
(p. As usual, if c* is a critical value, and u is a critical point of <P with ^(it) = c*, then u is 
called a least-energy solution. 

When S2 = 0, equation becomes 

Au + X — hu^^=0 in n. (1.4) 

When A < 0, the best constant S\{fl) of (|1.2p always satisfies 

5a (17) - 5o(17) = 5jv, 

where Sn is the Sobolev best constant. Thus, S\{fl) can not be attained in HQ{n), and as 

a consequence, c* could not be a critical value of <P. In fact, for < si < 2, it is not difhcult 

— 

to see that the constant c* of (|1.3p is always equal to jjS^ and is never a critical value 
for <P. Thus, there exist no least-energy solutions for equation (|1.4p when A < 0. However, 
when A>0,0<si<2 and .S2 = 0, the following theorem was proved in [TT] . 

Theorem B. Suppose N > 4 and G dil with H{Q) < 0. Then equation p.4p has a solution, 
provided that A > 0, and < si < 2. 

In summary, equation p.ip has been studied for either si = 2 or S2 = 0. The purpose 
of this paper is to study the remaining cases for equation (|l.ip . The following is one of our 
main theorem. 

Theorem 1.1. Suppose is a bounded smooth domain in M.^ , G dil and the mean 
curvature H{0) < 0. Then equation p.ip has a least-energy solution if 

> 3, A e M and < S2 < si < 2. 

In principle, the solvability of least energy solutions is closely related to the existence 
of the entire solutions of equation (|l.ip . i.e., = M.{^, the upper half-space. The existence 
of entire solutions on the upper half space has been proved by Bartsch. Peng and Zhang [T] 
when < S2 < si 2 and A < (^^)^ by Musina [IS] when A > 4, S2 = 0, si = 2 and 
< A < i^^y, and by Hsia, Lin and Wadade [T7] when S2 = 0, < si < 2 and A > 0. 
Close to Theorem ll.il the following existence of positive entire solutions will be proved in 
this paper. 

Theorem 1.2. Let A^ > 3, < .S2 < si < 2, A £ M and il = M^. Then equation pTTj) has a 
least- energy solution u G Hq{M.^). 

To complement Theorem ll.21 we prove the following non-existence of entire solutions of 
prT|) when S2 = and A < 0. 

Theorem 1.3. Let n = R^, < sj < 2 and A < 0. Suppose u{x) e Hl^^{M^) and u{x) > 
is a solution of (|1.4p . Then u(x) = 0. 
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We note that if solutions are assumed to be in Hq{M.{^), Theorem 11.31 with si = 2 has 
been proved in |17] . The authors of |17| employed the method of moving planes to prove 
Theorem II .31 where the behavior of u at oo is needed. One way to find asymptotic behavior 
is to apply the Kelvcin transform to u: 

It is a straightforward computation to show that M(y) satisfies 

Aw + A — ^+u~(y)=0 in BiHR^. 

But u is no longer contained in ii\^Ji^^\ i.e., the integration of Vu might be +oo in any 
neighborhood of 0. In this case, the origin is called a nonremovable singularity of u. It 
is a really interesting question : What is the asymptotic behavior of u near the singularity? 
Previously, this kind of problems have been studied: 

Am + g{y, u) + it «^ =0 in < |y| < 1. 

Under the monotonicity assumption of u: 

g{y,t)t "-2 is decreasing for large t > 0, 

it was proved that u{y) = 0(|?/|^"t^) near 0. See [3 [HI HI HH] • For our case, 

q(v,u) = A — ; — ; and A < 0. 

^ ' \y\'' 

Then g{y, t)^ "-^ is increasing in t > 0. Hence, the methods in [71 ISl HI [TU] can not work 
for our nonlincarity. We should address this asymptotic problem later. 

Our proof of Theorem 11.31 emplovs the idea of the method of moving spheres, a variant 
of the method of moving planes. The method of moving planes has been developed through 
the works by A.D. Alexandrov, Serrin [55] , and Gidas, Ni and Nirenberg [TB]. Here, we will 
not require any assumption on the behavior of solutions at oo, by taking some advantage of 
the upper half space M.^, while compared to M^. We think this proof might be useful in 
other problems also. See [3TJ \TE\ for some related results. 

This paper is organized as follows. In Section 2, we will prove Theorem 1.3 and a gener- 
alization of it. In Section 3, we will employ a blowing-up argument to prove Theorem 11.21 
This kind of arguments have been developed for studying the nonlinear equation involving 
the Sobolev critical exponent, see [3 ISl HI (TUl [H] . The existence of least-energy solutions of 
equation p.l|) with < S2 < si < 2 are obtained in Section 4. In final section, we discuss a 
perturbed equation of equation p.ip for the case A < 0, = S2 < si < 2. 



2 Nonexistence of Entire Solutions 

In this section, we begin with a proof of Theorem 11.31 We first make a remark about 
regularity of u{x). It is shown that u G C"(R:'^), for any a £ (0, 1). For a proof, see [TT] and 

m- 

If u = at some point of M^, then u = by the strong maximum principle. Hence, we 
will always assume that 

u{x) > 0. (2.1) 

Wc will prove a lemma below. 
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Lemma 2.1. Letu{x) be a vositive solution of equation (\1A^ . Suppose u Hl^^(W^). Then 

Before giving a proof of Lemma l^TTl we apply Lemma l^TT] to prove Theorem ll.3l 

Proof of Theorem ll.31 Suppose u{x) is a positive solution of equation (jl.4p . 

We claim u is uniformly bounded in any compact set of R^. Suppose the contrary, then 
there exist xi G R^, such that 

u{xi) — > cxD as i — >■ oo. 
By the monotonicity of u in xat— direction, we may assume that 

\xi\ — ?> oo. 

Consider 

Vi{x) = (1 — |a; — Xi\) 2 u(a;), |a; — i^j < 1. 
For some \xi — Xi\ < 1, 

Vi{xt) = max Vi{x), 

\x—Xi I < 1 

here we have used the fact that Vi{x) = for |x — Xi| = 1. 
Let ^ 

ai = -(1 - \xi - Xi\) > 0. 



Then 

It follows that 

Since 
we see that 

Consider 



2 

JV — 2 

{2ai)^^ u{xi) = Vi{x.i) > Vi{xi) = uixi) oo. 

2 

Ri aiU[Xi)"-'^ — !• oo. 

iV-2 

Vi{xi) > Vi{x) > ^ u{x), \/ X e Bc,^{xi), 

u{x) <2^^u{xi), \/ X £ Bcr^{xi). 



^i{y) } ( H ] , \y\ < Ri^ cTiUiixi) "-2 oo. 

\ u{x^)T^ I 



Then 



w^{0) = l, and u),(y)<2— , V |y| < i?, 
Using the equation satisfied by Ui, we have 

y 

Since |a;i| — > oo, it is clear that 

I , y 



u{Xi)'' 



> \xi \ — \xi — Xi\ — <7i > \xi \ — 2 — >■ oo, uniformly for \y\ < Ri. 
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Given the bound of Wi , we know from standard elliptic estimates that on every compact 
subset of M^, {wi} is bounded in C'^ norm. After passing to a subsequence, we have, 

w.~^w inCL(K?). 
Given the above estimates, and the equation of Wi, we have 

JV + 2 J.J 

Aw + w~ = 0, on R^, 

and 

w{0) = 1, w > on M^. 

By the strong maximum principle, w > on i?^. 

By the classification theorem of CafFarelli-Gidas-Spruck, 

iV-2 

where /x > and yo G I^^- 

But we know from the monotonicity oi Wi, w must be monotone in y^v-direction. This is 
a contradiction and the claim is proved. 

Let Uj(x' ,xn) = u{x' ,xn + rj) where Vj < Vj+i +oo as j — > +oo. By Lemma l^TTl 
Uj{x) < Uj+i{x). Since u{x) is uniformly bounded, Uj{x) — ?► Uooix) in Cf^^iM.^), where 
Uoo{x) is a positive solution to 

N + 2 

Awoo + =0 in R^. 

Again, Lemma l^TTI vields a contradiction to (|2.2p . Hence, the proof of Theorem 11.31 is com- 
plete. □ 

Proof of Lemma 12.11 The proof uses the method of moving spheres, a variant of the 
method of moving planes which arc developed through the works of Alexandrov, Scrrin j26) , 
and Gidas, Ni and Nirenberg [TB]. We also make use of the "narrow domain idea" from 
Bcrcstycki and Nirenberg [5]. 

Define 

XR := (O,--- ,0,-i?). 

Let 

( ^ ( ^ V^' ( , ^^jy-^B) 
\\v-xr\J V \y-XRY 

be the Kelvin transformation of u with respect to the ball B\{xr) with center xr and radius 
A > 0. By direct computations, we have for y G B\{xr) n R;?^, 

We want to show that 

u.^Av) > u{y) Vy e Bx{xr) n R^^, VA > R. (2.3) 

To prove (|2.3p . we first claim 

A 1 1 , , 

< Tzn, (2-4) 



\y-XR\J + - |y| 



6 



for y e Bx{xr) H M^, VA > R. 
For y e Bx{xr) r\^^,we write 

y-XR ^ Q 
\y - xr\ 

Then 



{6i, ■ ■ ■ ,9n), \y " xr\ = r. 

Mi(e)<r<A, (2.5) 



where is determined by 

Namely, 

ON 



xV' 1 1 



2.4p is equivalent to 



This is equivalent to 



< 



XR + ^e\- - \xR + r0\^ 



1 



For r satisfying (|2.5p . we have 

— > — >r>^i . 

Let 

In order to prove (|2.6p . we only need to prove 



<r'- — . (2.6) 



/;'(/.) <0, ^i(0)<^<^. (2.7) 



This follows from the following calculations, for /i > i-ii{0), 



\xR + ^lef7^'{^l) = 2/i|a.H + Me|'-M':^(k/? + M^n 

= 2jj.ReN{ni - fJ.) <o. 
We have proved (|2.7p . and therefore proved (|2.4p . It follows that 

-Aw,,,A + j^ul^^]-' > u,,,A(y)^, in i?A(.XR) n Rl- 

Thus 

- A {u^,^, - ") + ^ ("'S^' - ^ - n ■ (2.8) 

Write 

w\ = ■"2;fl,A - w, = max{0, -wx}. (2.9) 
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We first require tliat R < Xo{R) < 2R, then for R < X < Xo{R), we fiave 

+ < \XB.\ + ^<5R, yyeBxixR)nm^. 



Multiply to the inequality (j2.8p and integrate by parts on Bx{xu) OR^^, we have, using 
> on diBx{xB,)nR^), 



j 



"A 



< 



" + 2 JV + 2 



< — sup M"-2 / [w^) dy 

< C(iV)|BA(2:K)nR^'|^||u;^f ^ 



L"-2(BA(xR)nR^) 

|Vui^|^( 



Now we can choose Xo{R) > R but very close to R, then \B\{x]i) fl is small, and we 
have 



/ 

JBx{xR)nm':^ 



Bx{xR)nM!^ 



This implies Vui^;^ = in B\{xb.) H M:'^ and therefore, since = on dB\{xfj) D M.'^, 
= in B\{xji) n R^. Step 1 is established. 

Define 

A(i?) := sup{^ I Ai > i?, and u^R,x{y) > u{y), Wye Bx{xii) n , V i? < A < ^}. 
By Step 1, X{R) is well defined and R < X{R} < oo. 
Step 2. X(R) = oo for all i? > 0. 

We establish Step 2 by contradiction. Suppose that A = X{R) < oo for some R > 0. 
Then 

u,,^-x{y)>u{y), yyeB-^{xn)nR'^. 
Since u^^ ^ > w on Bx{xr) Ci dR^, we have, by the strong maximum principle, 

".«,A(y) > yyeBx{xH)nR^. 

For 6 > small, and the value to be fixed below, let 

K := {y e B-xixji) D \ dist{y, d{Bx{xR) n R^')) > 5}. 



Then 



b := mini/j); > 0, 
K 



where we have used the notation (|2.9p . 

Consider A < A < A + e, where the value of e = e{d) < 5 is chosen so that 

w\>^, on K, VA<A<A + e. (2.10) 

Multiplying (|2.8p by and integrating by parts on {Bx{xr) n R^) \ K leads to, as 
before, 



/ 

< 



{B^ixn)nR'^)\K \yr 

<C\{Bx{xR)nR';^)\K\^ [ \Vw~\^dy. 

■J(B^{xR)nR':;^)\K 

Now we can fix the value of S so that C\{Bx{xr) n M^) \K\- < ^, and wc obtain as before 
lu^ = on {Bx{xr) n M^) \ K, i.e. 

uxnMy) > <y)^ V y G {Bx{xr) r\M.l)\K, v a < a < a + e. 

This and (|2.10p contradicts to the definition of A(i?). Step 2 is established. 
By Step 2, we have 

{y)>u{y), VyeBR+aixR)nR'^,W R,a>0. (2.11) 
It follows, for every y G M.^, and every a > yn, 

u{y) < lim u^j^,R+a{y) ""(j/i, • ■ • ,?/jv-i, 2a - y^)- 

-H— >oo 

The above implies 

u{yir-- ,yN-i,s) < u{yi,--- ,yN-i,t), V < s < t. 

Wc have proved 



du 



dXN 

Applying to the equation of u leads to 



> 0, in 



, du , /2*(s)-l 2n.)_2 ^ + 2 ^\ , 9U , 9 . 1 X n • 



I, AT 



AT -2 J dxN dxN Ixl" 



By the strong maximum principle, we have is always zero or strictly positive. But u ~ 
on the boundary on and positive in W^, so we must have > in R^. Lemma ETTl is 
established. □ 
The main theorem in this section is the following generalization of Theorem 1.3. 
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Theorem 2.2. Let Si e (0,2], Pi e K^^^ and let u{x) > be a solution of 

' ,2* ^ 



^^^,a;-P,|^» +' (2.12) 



^ It- - P, |si + ' 

u{x) = on aM^. 

Suppose u e L°°(]R^^) n i?/„,^(M^). T/ien u(a:) = 0. 

Proof. The main step is to show that > as did in Lemma \n\ This second proof 
could work for the general situation of p.l2| . but the boundedness of u is required! The 
proof is divided into several steps. 

Step 1. u{x) -H' as +oo. Suppose not. We may assume there are Xj — )■ +oo, 

u{xj) > C > for some positive constant C. Let Uj[x) = u{x + Xj). By elliptic estimates, 
Uj{x) is bounded in in any compact set of R;'^. By passing to a subsequence, we may 
assume Uj{x) -> u{x) in C'i^c^+) ^^"^ u{x) satisfies 

f Au(a;) + = in , 

<^ ^ ^ +' 2.13 

\u = Q on dP^ 



But it is well-known that (|2.13p has no positive solutions. Thus, li = in R:'J^ which 
contradicts to w(0) > C > 0. So, Step 1 is proved. 

Step 2. We claim for any A > 0, 

u{y^)>u{y) for X e Ea = |(?/i,y2, ■ ■ • ,2/Jv) < < a|, 

where = (j/i, ■ • • , yN-i, 2A — Vn)- This step is a standard application of the method of 
moving planes. We give a sketch of proofs for the sake of completeness. Let 

wx{y) = u{y^) - u{y). 

Then we have 
Thus wx{y) satisfies 

Au;A(y) + (Ciiy) + C2{y))wxiy) < in S 

where 



A- 



Ci(y)<0, and C2{y) = 



UN-2 (^yX^ _ uJV-2 (y) 



u(?/^) - u(y) 

By Step 1, 6*2(2/) = 0(1) as \y\ — s> +00 and y G Ea- 
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To prove wx{y) > in Sa for A small, we consider the comparison function, 

v{y)^i-yN, 0<yN<\ 

and let 

w\{y) ^ '^^^y^ ^ i.e., wxiy) ^wx{y)v{y). 
v{y) 

Thus, w\ satisfies 

AW;,(y) + • Vwxiy) + (C,{y) + C^iy) - -^)wx{y) < 0, 

v[y) \ v[y)J (2.14) 

wx{y',0)>0 and uJA(y',A) = 0. 
Choose A small such that 

iV + 2 



iV-2 



u—{y)<2, 0<yN<X- 



Now suppose the set |y 'w\{y) < o| 0. 

Because W\ > on dT,x and \im\y\^^aoW x{y) = 0, it is easy to see the minimum of wx 
can be achieved. Let y G Sa such that 

wx{y) = inf wx{y) < 0. 

Since wx{y) < 0, 

C(y)<^^^(y)<2. 
By applying the maximum principle, (|2.14p yields 

< (Ciiy) + C2{y) - ^)^A(y) < 0, 

which is a contradiction. Hence, wx{y) > G Sa- 
Let 

A = sup|a > Vy e I;^,0 < /i < a|. 

We claim A ~ +oo. Otherwise, we have 

wj{y) > Vy G Ex, 
Ky',A)<0 



dn^, , (2-15) 



by the strong maximum principle and Hopf boundary point lemma. By the definition of A, 
there are Xj J, A such that {y| wx-{y) < 0, y G Sa^ } ^ 0- Set 

WAj(2/) = wxj{y)v{y), 

where 

v{y) = (X + lf-y%, yGEA,. 

Then Wxj satisfies 

AwA, (y) + 2 V log w (y) • VwA, (y) 

/ 4 \ (2.16) 

+ (Ci(y) + C.(y)-^)TZyA, <0 
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Suppose w\-[yj) = infygs^^. w\.{y) < 0. By (|2.15p . we have \yj\ +00. Note that 

C2{yj) < ^0 as j ^ +00. 

Again, by the maximum principle, (|2.16p yields a contradiction. Therefore, Step 2 is proved. 
Obviously, the conclusion of Lemma 12. II follows immediately from Step 2. □ 
After the proof > 0, it is clear from the last step in the proof of Theorem 11.31 that the 
conclusion of Theorem [221 holds. □ 



Remark 2.3. If Pi = Pj Vi ^ j, then the proof of Lemma [2.11 still holds. Hence, in this 
case, the boundedness assumption is not necessary for the conclusion of Theorem 12.21 

3 Existence of Entire Solutions 

In this section, we will give a proof of Theorem ll.2l To prove Theorem ll.21 we choose a 
convex domain D, with € dQ and consider the following equation. For any small e > 

Au + X— h-rn — = inn, 

Ixl-'a (3.1) 

u{x) > in and u{x) = on 9r2, 

where pi(e) = 2*(si) - 1 - e and p2{e) = 2*(s2) - 1 - (i5f7)£- 
For e > 0, we let 

' ; — ; ax 



for u G H}){n) and 



P2(e) + 1 



c* = inf max<?e(w), 

^ PeVweP 



where V is the class of all continuous paths in HQ{fl) connecting and some uq such that 
^e(wo) < 0. It is easy to see that c* < C for some constant C independent of e. Since for 
e > 0, satisfies the P-S condition, it is known that c* is a critical point of i.e., there 
exists a solution G ^^o(^^) with <P^{ui:) = c*. Thus, 



2 Jj2 l^^el " Pi(e) + 1 Jf2 = i ~ P2(e} + 1 Jn 

r I 19 1 \ r r uP2(e)+i 



(3.2) 



From p.2p . we have 



1 1 \ /■ , ,0 . / 1 1 \ /■ 



, , , , , iVuel da; + — / — ; — : dx = c* 

By noting both of -i — and ^^^3)+! ~ are positive, we have 

|Vuepdx+ / — dx+ / ^- dx<C< +00. (3.3) 
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Therefore, by passing to a subsequence if necessary, we might assume u in i?o(ri) as 

e ^ 0. If It ^ 0, then u is a solution of 



I A^ + A^ + ^=0 inn, ^^^^^ 
1 u = on dfl. 

However, the standard Pohozaev indentity yields that equation p.4p has no positive solutions 
because both of pi and p2 are critical exponents. Thus u = and Ui^{x) must blow up as 
e ^ 0. 

Before pocccding further, we will briefly discuss the regularity of u at 0. Because si < 2, 
we can prove that 

ueCHn)_ if .Si < 1 + i 

ueC^'/^m forallO</3<l ifsi = l + f, (3.5) 
u e (H) for all < /3 < if si >"l + f , 



see [IT]. 

Let 



n 

By direct computations, we have 



_ P2(g)-1 

Ue{xs) = n'iaxu£(a;) = and fc^ = TOe ^""^ . 



7 + 



First, we claim 

\Xe\=Oik,). (3.6) 

Suppose not. By passing to a subsequence if necessary, we may assume 

lim — — = +00. 

e-i-O fcg 

By scaling, we set 

Ve(y) = m He, 

nie 



where 



ne = {yeR^\xe+reyen}, and r, = l^r^l^fce = = (^)^fce- 



By equation (j3.1[) , (y) satisfies 

2/^=1!^ and We(?/) < W£(0) 1. 

Let — !> iJ as e — > 0, where either H = M.^ or _ff is a closed half space of M^. Note 
(j^)'*!"'*^ and 1^ = (-[Itj)^^ tend to as e ^ 0. Then by applying elliptic estimates, Ve 
converges to v in Cfg^{H), where 

AC + =0 in H. 
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If if is a half space of R^, then v also satisfies v = on dH. Since p2 = ^ 1 < ^^fi 

v{y) = in H no matter H is or a half space. But it yields a contradiction to v{Q) ~ 1. 
Thus, the claim is proved. 

After (|3.6p is established, we set 
Then v^{y) satisfies 



„P2(e) 



Aw. + A 







Sl 













S2 









in 



where Vlp 



{y e 



pN 



k^y G ft}. Since ^ is bounded, without loss of generality, we 



as e — > 0, where if is a half spae of 

^2 



may assume |^ — > yo- Therefore, fl^ 

—yo G dH and by the elliptic estimates, v^{y) — > v{y) in Cfg^{H). Clearly, v satisfies 



with 



w = on 



= in ii. 



(3.7) 



Since v{0) = 1, we have yo ^ 0. By a linear transformation of y, ii can be map onto M.^ 
and is an entire solution of equation (|l.ip with il = E;!^. This completes the proof of the 
existence part of Thcorcm ll.2l □ 

Remark. Suppose w is a positive entire soltion of (|l.ip . Then the Kelvin transformation 
"f^iy) = |2/P~"''^(^p) is s-lso a positive entire solution. By the regularity (|3.5p . < C|y| 

for \y\ < 1. Thus, 

< for |y|>l. (3.8) 

By the standard gradient estimate, we have 

|V«(2/)| < for \y\ > 1. (3.9) 

By using the well-known method of moving sphere, it can be proved that after a suitable 
scaling, v{y) = v{y). Since the argument is standard now, the proof is omitted here. 

Corollary 3.1. There exists an entire solution v of equation (jl.ip with Vl = M.^ such that 
the critical value ^(w) = inf{<?(w) | u is an entire solution of p.ip }. 

Proof. We first note that 

|(f>(u) u is a positive entire solution of ^ 0, 



because 



\Vu\^dy = A 



< C 



u 



2*(si) 



N \X\' 



-dy - 



/2*(«2) 



-dy 



( I \yu\^dy 



\Vu\'dy 



implies ||Vw|| > cq for some constant cq > 0. 
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Suppose Vj is a sequence of positive entire solutions of 

vj =0 on dR^ 

such that <P{vj) J, inf{<?(w) | u is an entire solution of By the remark above, we can 

assume Vj{y) = Vj{y). By (|3.2p again, || Vuj ||^2(][jiV) < C for some constant C > 0. Let 

^ V in i?oHR+)- If w 7^ 0, then 

1 1 f 11 f v^^'^^ 

. lim Hvj) = - — ^) lim / \Vv,fdy + (— — - — — ) . lim / ^-.—dy 



f 1 1 f 

-) lim / \Vv,fdy+{ ) lim / 

11/" 11/" 
>(- -) / |Vupd2/ + ( )/ !^-—dy^${v). 













P2 + 1 




L 





Then it yields the conclusion of Corollarv l3.1l 

If Vj 0, then maxvj{y) — >■ +oo, because Vj{y) = Vj{y) implies 
|y|<2 

2 Pi + 1 7bi Pi + 1 P2 + 1 Jb2 \yr 

By the proof of Theorem ll.21 we see that Vj blows up at y = and the scaling Wj (y) : 

_ 2 

where Vj{xj) = max Vj(y) — oo, kj = m "^^^ and ui is also a positive entire solution of 
\y\<2 

equation p.ip . Thus, 

1 11/" 11/" 
lim -<Z>(u,) > (- ) / iVtupdw + ( ) / — - — dy = <P(w), 

which yields 

inf{«?(u) I It is an entire solution of equation (jl.ip = 0}, 
a contradiction. Hence, Vj -f^ 0, and Corollarv l3.1l is proved. □ 



4 Proof of Theorem ll.il 

Let v(%j) be a least-energy solution of 



\ w(y) > in M^^ and v{y) ^ on ^M^, 

and 



(4.1) 



2jRiv 2*(si)7Riv |y|«i 2*(s2)Jr" jy^^ 
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Lemma 4.1. Suppose that is a bounded smooth domain in M.^ with G d^l. If H{Q) < 0, 
then there exists a nonnegative function vq G -ffo(f^) \ {0} such that 

ma.x<P(tvn) < ci. 
t>o 

Proof. Without loss of generality, we may assume that in a neighborhood of 0, d^l can 
be represented by Xn = (p{x'), where x' = {xi,--- ,xn-i), ¥'(0) = 0, VV(0) = 0, V = 
• ■ • , 9jv~i), and the outer normal of dfl at is — e^v = (0, • • • ,0, —1). Define 

(j>{x) := {x',XN - ^{x')). 

We choose a small positive number tq so that there exist neighborhoods of 0, U and U , such 
that (^([/) = BroiO): (f>iUnn) = B+{0), (j>{U) = Bn.(0) and 4){Unn) = Bto{0). Here, we 
adopt the notation: 

B+(0) Br„nR^ for ro > 0. 
Let r] £ C^{U) be a positive cut-off function with 7] = 1 in U. Set 

Ui^{x) :~ r]{x)v^{x) := ri{x)e ~v ^^^"^^ x £ il. 

For t > 0, we have 



(4.3) 

In what follows, we estimate each integral on the right-hand side of (j4.3p . Basically, 
the computation will be similar to Lemma 2.2 in [TT]. For the sake of completeness, we will 
sketch the proof here. We refer the readers to [11] for details of computation. 

By the change of the variable = y, we get 

/ \\7u^\'^dx^ / T]'^\\7ve\^dx - / ■q{A-q)vldx 
Jn Junn Junn 

\Vv{y)\^dy -2 f 77 (0" '(ej/))" dNv{y)V'v{y) ■ {V^){ey')dy + 0{e^). 

JBt^ 

s 

By using integration by parts and equation (|4.ip , the second term can be estimated as the 
following. 

-2 f 77 {r\ey)YdNv{y)Vv{y) ■ {V^){ey')dy 
Jb+^ 

N-1 

rj {r\ey)f dNv{y) J] duviyMey') + Oie') 

I i=l 



^{r\ey))' d^{{d^v{y)f\ v{ey')dy 



' v{(l) (ey)) ^7-|T -^{ey)dy 



2*(si)£M, \y\ 
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2*is2)eJBt^ ' " \y\ 

= :h+h + h + 0{e^). 
Since d^l is at 0, ip can be expanded as 

JV-l 

^{y')=Y,a,yj + o{\)\yf 

i=l 

Hence, 

h = - f ii{r\ey')fdNv{y',Q)^{ey')dy' 

N-1 



£ V a. / idNviy', 0)f y^dy'il + o(l)) + Oie^) = K,HiO)e{l + o(l)) + 0(6^), 



where 



Xi= / \dNv{y\0)\'\y'fdy' 



where 



and 



= ~K2H{0){l + oil))e + Oie^), 



2Xs, f v^yr^^^Wm, 



= -A-3i?(0)£(l + o(l)) + O(e2), 



where 



By p.8p and p.9p . if,, z = 1, 2, 3, are finite. Therefore, we have 

/ iVuei'da:- / \Vv\^dy + eH{0){Ki-K2~K3){l + o{l)) + Oie'), 



and similarly, we have 



xf4P^d. = xf ^^dy-'-^f + 
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,,2*(si) 

dy - 2*(si)/v2i?(0)e(l + o(l)) + 0{e^), 



\y\ 

and 

/ ^T^dy-r{s-2)K,H{0)e{l + o{l)) + O{s'). 
Therfore, 

Ai2*(si) /• ^,2*(si) ^2*(S2) /• „2-(s2) 



'^{iue) = -T7 / \^v\Hv - ——— / -y—dy - —— / 



^2 +2*(si) 

+ Y i£H{0){Ki - K2 - K3) + 0(1)) + X2if(0)(l + o(l)) 

+ !!i!!lx37J(0)(l + o(l))e + 0(£2) /^(t) + f^{t) + ©(e^), 



\f2*(si) /• „2*(si) +2*(S2) /• „2-(si) 



where 

Since 2* (52) > 2*(si), 'P{tu^) has the unique maximum. Note that 

max/i(i) = /i(l) ci. 



Hence, the maximum of <P{tUe) occurs at = 1 + o(l). By noting that 
/2(t)=eiJ(0) 



+2 ^2-(si) ^2*(S2) 

-{K, -K2- K3 + 0(1)) + ^—^2(1 + 0(1)) + ^—^3(1 + 0(1)) 



and /2(1) = eH{0)Ki{l + o(l)) < 0. Hence, we have 

nmx<P{tu,) ^ ^{Uu,) < h{t,) + ^(te) < h{t,) < /i(l) = ci. 

Thus Lcmma r4.1l is proved. □ 

We are now in a position to prove Theorem ll.il 

Proof of Theorem 11.11 As before, we let for small positive e, 

^yj^"!'^^ p,ie) + lJn \x\^^ P2{e) + lJn ' 



where pi{e) = 2*(si) - 1 - e and ^2(2) = 2*(s2) - 1 - [jz^j^- By Lemma HH there exists 
uo E Hq{Q) such that <f>e(uo) < and 

c* ~ inf max$^(w), 

where V is the class of all continuous paths in i^o(il) connecting with uq. Let ci be the 
positive constant defined by (|4.2p . Then Lemma HTI yields 

c; < ci, (4.4) 



18 



provided that e G [0, £o] for some small Eq > 0. For e > 0, there exists a solution G HI{Q) 
of 



Awe + A—- — + — - — =0 in 1], 



= 0, on 
and = Cg. Similar to p.2p . we have 



iViiel rfa; < Ci, 

for some constant Ci independent of e. By passing to a subsequence if necessary, we may 
assume 

^ u in Hq{Q?). 

If M ^ 0, then clearly u is a solution of and Theorem 11.11 is proved. So it remains to 
prove M ^ in $7. 

Suppose u = 0. As in Section 3, there exists G such that 

u^{x^) = m.&yiu^{x) — — >■ +oo, 

and after a linear transformation on y, we have 

^'^(y> = ^"(y) Qoc(IR+), 

where = nrip ^^"^ and u satisfies 



Av + X— h T-r- = in 

t; = on M?. 



Also by a direct computation, we have 

liminf / \\/u^fdx> / \Vvfdy, 

and 



yP2(e) + l /• yP2 + l 



By (j3.2p . we have 



Thus, gSl) and (glS]) yields 

11/" 11/" w2*(s2) 

c* = lime; = (--—-) / |Vvpdy+(— ^) / ——dy = ci, 
e^o 2 2*(si) 7rJV 2*(si) 2*(S2) Jk« 

which contradicts to (|4.4p . Hence, m ^ 0, and then Theorem 11.11 is proved. 
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(4.5) 



lim / — dx > / — - — dy. (4.6) 



5 The Case S2 = 

As discussed in Introduction, equation with A < has no least-energy solutions. 
In this sectin, we will consider a perturbed equation from equation (jl.ip : 

{2*(s)-l N + 2 

Au - " +uP + u— = in 1], ^^^^ 

u{x) > in ri and M(a;) = on 50. 

Theorem 5.1. Suppose 2*(s) — 1 < p < a^iii > 4. T/ien equation (|5.1|) /las a positive 
solution. 

Proof. Let 

<P{u) I \Vu\Hx+^ I Ili^l^dx-^ / {u+Y+^dx-^^—^ I {u+)^-dx. 



Choose ^ .To G and 



v^[x) ^ (f){x) 



1 + ^i^\x — xoP , 

for large fJ. > 0, where (j){x) is a cut-off function near xq. Then it is not difficult to show that 

1 iL 

t>0 

provided that 2*(s) — 1 < p < and fi is sufficiently large. Let uq = toVf^, and 

c* = inf max<P(w), 

Pev weP 

where V is the class of continuous paths in 11^(^1) connecting and uq. Then it is easy to 
see 

1 

A' 

Wc claim: c* is a critical value for <1>. By the deformation lemma (see lemma in []), there 
exists Uj G HQ{n) such that 



< < -5^ . (5.2) 



'^(mj) = c4l + o(l)) 

where o(I) — !> as j — > +oo. By (|5.2p and (|5.3|) . we have 

/" iVujf da; < C 

for some constant C independent of j. By passing to a subsequence if necessary, we assume 



Uj — ^ u 



Uj — > u 



in 7?i(f^), 
in LP+i(r2). 



li u ^ 0, then it is easy to see m is a solution of (|5.ip and <?(it) = c*. Hence, it remains to 
show that u ^ 0. We prove it by contradiction. 
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Now suppose u = 0, and set 



«) 



2' is) 



Jn Jn Fl Jo 

Then JO]) implies 



and 

C = A + B. (5.5) 

By the Sobolev inequahty, (|5.5p imphes 

C = A + B>A> SnC^~^. 

Thus, we have 

C > 5| and A > SnC^~^ > . 

Then (inH) yields 

,1 iV-2, , ,1 iV-2, 1 
^*^(2-^)^+(2^-^)^^]V^- 

a contradiction to (j5.2p . Hence, Theorem l5.1l is proved. □ 
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